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Abstract 


/ 

•  1 

We  show  how  to  solve  the  linear  least-squares  smoothing  problem  for 
multipoint  boundary  value  models.  The  complementary  model  is  derived 
and  is  used  to  determine  '  e  Hamiltonian  equations  for  the  smoothed  state 
estimate  and  its  error  covariance.  Stable  algorithms  are  obtained  using  an 
invariant  imbedding/multiple  shooting  procedure. 
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1.  Introduction 


Many  physical  systems  can  be  modeled  by  linear  partial  differential 
equations  with  various  types  of  boundary  conditions.  When  such  systems  are 
subject  to  random  excitations,  it  is  often  necessary  (for  reliability  analysis  or 
control,  for  example)  to  find  the  smoothed  estimate  of  the  state  vector 
based  on  noisy  observations.  In  certain  cases,  such  multidimensional  models 
can  be  Fourier  transformed  into  sets  of  uncoupled  ordinary  differential 
equation  models  (see,  for  example,  [RWIJ,  [RW2],  [LAW]).  For  ordinary 
differential  equations  with  two-point  boundary  conditions,  the  smoothing 
problem  has  been  studied  in  [AWL],  [RWl],  [RW2],  [BW],  [NAWL],  [W],  [LAW], 
[LFK]. 

We  intend  in  this  paper  to  investigate  the  case  of  multipoint  boundary 
conditions.  One  context  in  which  multipoint  boundary  conditions  arise  is 
that  of  flexible  structures,  like  bridges  and  moorings,  which  consist  of 
components  coupled  end  to  end  (see,  for  example,  [CDKP]).  Using  the 
concept  of  the  complementary  model,  introduced  in  [WD],  along  with 
invariant  imbedding  and  multiple  shooting,  we  will  derive  efficient,  stable 
algorithms  for  the  smoothed  state  estimate  and  its  error  covariance.  As  we 
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z{x)  =  Az{x)  +  Bu{x).  X  €  [Xo.Xjv_i  1 


(1) 


iV-1 

5^VtZ(xJ  =  r,  Xq  <  Xi  <...<  (2) 

t>o 

where  x  is  typically  a  spatial  variable  and  u  is  a  zero-mean,  unit  intensity 
white  noise  with  m  components,  r  is  a  zero-mean  random  n-vector  with 

Err'  =  Q 

z  is  a  continuous  n-component  state  vector,  and  A,  B,  Vq,  Vj . 

constant  matrices  of  appropriate  size.  We  assume  that  u  and  r  are 
uncorrelated.  We  have  continuous  measurements  given  by 

yix)  =  Cz(x} + u(x),  X  e  [aTo.x^^.j ]  ( 3 ) 

where  C  is  a  pxn  matrix  and  u  is  a  zero-mean,  unit  intensity  white  noise 
which  is  uncorrelated  with  u  and  r.  Given  the  measurements  y,  our 
objective  is  to  find  the  smoothed  estimate  (in  the  linear  least-squares  sense) 
of  the  state  z,  and  its  associated  error  covariance. 

As  a  simple  example  of  a  multipoint  boundary  value  model,  consider  a 
static  Euler-Bemoulli  beam  with  fiexural  rigidity  p  and  a  continuously 
distributed  load  with  density  il  In  state  space  form,  the  beam  model  is 
given  by  eqn.  (1)  with 
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where  the  first  component  of  the  state  vector  is  the  deflection  of  the  beam 
at  point  X.  Now  suppose  there  are  boundary  conditions  consisting  of  pins  at 
Xq  and  x^  and  a  clamp  at  x^ .  Then  these  can  be  represented  by  eqn.  (2)  with 
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and  with  Q  quantifying  the  looseness,  or  uncertainty,  of  the  pins  and  clamp. 

2.  The  Complementary  Model 

The  Hamiltonian  equations  for  the  smoothed  estimate  are  most  readily 
derived  using  the  method  of  complementary  models  [WDl,  [AWL],  IRW2], 

[AK].  If  Y  is  the  closed  linear  span  of  the  components  of  y,  then  a  comple¬ 
mentary  model  is,  in  the  case  at  hand,  a  multipoint  boundary  value  model 
which  generates  complementary  variables,  denoted  y^  and  6,  who'i.e  com¬ 
ponents  span  the  orthogonal  complement  of  Y.  In  order  to  derive  a  comple¬ 
mentary  model,  we  must  first  solve  for  z  in  terms  of  r  and  u. 
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Integrating  eqn.  (1)  gives 


z(x)  =  0(x,Xo)z(xQ)-h  r  0lx,^}Bu(^)d^  (4) 

Jjto 

where  <i>  is  the  state  transition  matrix.  Substituting  into  eqn.  (2)  3aelds 

r  =  '£Vj(P(Xj,Xo)z(Xo)+^Vjp0(Xj,^)Bul^)d^  (5) 

J=0 

The  boundary  value  problem  will  be  well-posed  (that  is.  u  and  r  will  give  rise 
to  a  unique  z)  if  and  only  if  the  matrix 

J=0 

is  nonsingular.  By  multiplying  eqn.  (2)  on  the  left  by  the  inverse  of  this 
matrix,  we  can  always  ensure  that 

XVj<P(;<j.x„)  =  /  (6) 

J-0 

In  what  follows  it  will  be  assumed  that  eqn.  (6)  holds. 

Solving  eqn.  (5)  for  z{Xq)  and  substituting  into  eqn.  (4),  we  get 
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(7) 


z(x)  =  <P(x,Xo]r+  r"''  Glx,^)Bu(^)dl 

where  the  multipoint  Green's  function  G(x,^  is  given  by 

0(x.xj'^V^0lx^,^l  x>^ 

GU.^)=  Xj<^<Xj,,  (8) 

-^[x,Xo) '^Vy.Oix^,^),  x<^ 

fc=j+i 

for  j=0,l . N-2.  By  analogy  with  previous  work  [WD],  we  can  deduce  from 

the  form  of  eqns.  (3)  and  (7)  that  complementary  variables  are  given  by 

yjx)  =  uix)-B'r'‘''G'{^,x)C'v[^)d^  (9) 

De  =  r-Qr-'<t>’{^.x„)C'v[i)di  (10) 

where  D  is  any  full-rank  matrix  satisfying 

DD'^Q 

Defining  a  complementary  state  by 

zJx)=r"G'(lx)C'v[^)d^  (11) 

*•*0 
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we  see  that 


yJx)  =  uix)-B'zJx)  (12) 

Note  that  in  contrast  to  the  two-point  case  in  which  it  is  continuous,  the 
complementary  state  here  has  jumps  at  the  points  x=Xi,x2,...Xf,.2- 

Just  as  with  eqn.  (9),  we  would  like  to  express  eqn.  (10)  in  terms  of  z^. 
Defining 


Sj=z,{Xj-)-z,iXj+),  J  =  l,2 . N-2  (13) 

and  using  eqns.  (8)  and  (11),  we  find  that 


ZcU„.,)  =  -VJ-i  f'"" 

Jxo 

(14) 

Sj = 

(15) 

Zc(Zo)  =  Vjf"-'  <P'(5.A:„)C'i;(|)d^ 

(16) 

Using  the  above  along  with  eqn.  (6),  we  can  rewrite  eqn.  (10)  as 


N-2 

De  =  r- Qlz^iXo)-  X <P'{Xj,Xo)5j  -  0'[Xs.i,Xq)z,{Xs.i)] 


>1 


(17) 
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Next,  we  want  to  express  as  the  state  vector  of  a  multipoint  boundary  value 
model  like  eqns.  (l)-(2).  Differentiating  eqn.  (11)  gives 


4 (^)  =  -AX ) - C'vixl  xe[Xo, ] \ {Xj }"?  (18) 

The  boundary  conditions  that  go  with  eqn.  (18)  must  yield  a  unique  z^  which 

matches  eqn.  (11).  Since  eqn.  (18)  is  valid  in  each  of  N-1  subintervals,  we 
need  a  total  of  (N-l)n  independent  boundary  conditions  for  a  unique  solu¬ 
tion.  Therefore  the  boundary  conditions  for  the  complementary  state  must 
have  the  form 


N-2 


>1 


(19) 


for  some  suitable  set  of  matrices  (KJ  of  size  (N-  l)nxn.  In  fact,  if 


Ko=[V,  V,  ... 

K,=[I  0  ...  of-Ko<P'(Xj,Xo) 

K^.,=[0  ...  0  li-K^0'[x^.„x^) 


(20) 


it  can  be  verified  (see  the  appendix)  that  the  boundary  value  problem  of 
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eqns.  (18)-(19)  is  well-posed  and  that  its  solution  matches  eqn.  (11).  Eqns. 
(12),  (17)-(20)  constitute  a  complementary  model  for  eqns.  (l)-(3). 

3.  The  Hamiltonian  Equations 

The  value  of  a  complementary  model  now  becomes  clear  because  by 
cross -substituting  between  the  original  model  and  the  complementary 
model,  we  can  eliminate  u,  r,  and  v,  and  then  project  onto  the  space 
spanned  by  the  observations  to  obtain  the  Hamiltonian  equations 

zix)  =  Az[x)  +  BB%[xi  X  6  [Xo,a:jv_i]  (2  1 ) 

k^{x]  =  -A%{x)  +  C'Cz{x)-C'y{x),  (22) 

with  boundary  conditions 


/V-l 

Z 

J=0 


'-9' 

fV-2 

'Q0'{xj,xoy 

9^  (xj^_],Xq) 

0 

z{Xj)  + 

Ko. 

Zc(^o)+Z 

J=1 

5j  + 

!zcf^iv-i)  =  0  (23) 


where  the  "hat"  denotes  linear  least-squares  estimate.  Note  that  since  the 
complementary  variables  and  6  are  uncorrelated  with  y,  their  estimates 

are  zero. 

By  using  invariant  imbedding,  we  can  transform  eqns.  (21)-(23)  so 
that  the  resulting  differential  equations  are  partially  decoupled  and  as3nnp- 
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totically  stable.  Let  Mx)  be  the  solution  to  the  following  Riccati  equation 


N[x)  =  -N{x)A  -  A'Nix)  +  N[x)BB'N{x)  -  C'C 

mx^.,)  =  0 


Then  the  coordinate  change 


p{x)  =  iV(x)zU)  +  z^[x) 

transforms  the  above  Hamiltonian  equations  into 

kx)  =  iA-BB'Nix]]Hx)  +  BB'p[x),  xe[Xo,x^,i]  (25) 

pix)  =  -{A  -  BB'Nix)yp{x)  - C'yix),  x  e  Uq.aTjv.i ]  \  {Xj}%^  (2  6) 


with  boundary  conditions 


Vo  +  QN(Xo) 
-KoNiXo) 


-gTz(xo) 

^oJLp(^o) 


N-l 

J=I 


0 


Q0'[Xj,Xo)' 


K. 


z{Xj)' 


pj 


=  0 


(27) 


where  we  have  defined 


.  _{p(Xj-]-p{Xj+),  j  =  1.2 . N-2 

tp(^w-i).  J  =  N-l 


If  (>\,B)  is  stabilizable  and  (A.C)  is  detectable,  then  eqns.  (25)  and  (26)  will 
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be  asymptotically  stable  in  the  directions  of  increasing  and  decreasing  x, 
respectively.  Note  that  the  Riccati  equation  is  identical  to  one  that  arises  in 
smoothing  for  initial  value  models  [WD],  lAK].  Other  invariant  imbedding 
transformations  are  possible,  for  example  using  two  Riccati  equations,  but 
the  one  used  here  is  the  most  efficient  in  terms  of  the  amount  of  computa¬ 
tion  required  to  find  the  smoothed  estimate  and  its  error  covariance  [W], 

4.  The  Smoothed  State  Estimate 

The  transformed  Hamiltonian  equations  can  now  be  solved  using  a 
multiple  shooting  procedure.  First  solve  the  following  initial  value  systems: 

Po(x)  =  -{A  - BB'N{x)ypoix) - C'yix),  PoUw-i)  =  0  (28) 

io(x)  =  {A-BB'N{x))z^ix)  +  BB'p^[x),  z^ix^)  =  0  (29) 

The  solution  of  eqn.  (29)  can  be  interpreted  as  the  smoothed  estimate  of 
z{x)  when  Vq=I,  Vj=0  for  j>0,  and  0=0;  or  in  other  words,  when  the  original 

model  is  an  initial  value  model  with  zero  initial  condition  [WD]. 

Now  it  can  be  checked  by  differentiation  that  for  x^.^<x^^,  1^<N-1, 


z{x)  =  Zo{x]+  •P(x,Xo)z(Xo)-t-  2  'f'(x,Xj)MiXj)S^j  +  ^M[x)'f"[Xj,x)Sp^  (30) 


N-l 
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and  for 


itf-i 


p[x)  =  PoU)  +  Y,  ^'{Xj,x)S 

j^k 


(31) 


where  is  the  state  transition  matrix  of  (A-BB'N(x))  and 


M(x)  =  (A-  BB'N(x))M(x)  +  M(x)( A  -  BB'NMV  +  BB'  ^ , 

M(Xo)  =  0 

We  can  determine  the  unknown  quantities  in  eqn,  (30)  by  obtaining  z[xi^] , 
k=l,2,...,N-l,  and  p(Xo)  from  eqns.  (30)  and  (31),  respectively,  and  sub¬ 
stituting  into  eqn.  (27).  This  results  in  the  following  system: 


'ziXo)' 

Po  ("^O  ) 

=  i^i 

Zoix,) 

_Zo{Xff_i)_ 

(33) 


'  9  -K 

-Ko  0 

.  i"2  = 

■N(Xo)  -A'' 
-A  -L 

,  A  = 

*F(Xi.Xo)-<P(Xi,Xo) 

^  !F(x  [f_i  ,Xg)  —  0(x  ff_i ,  Xq  )_ 

1  1 


where 


MUi)  •••  M{x^]*P'{Xfj_i,x^) 

*PU2.Xi)MUi)  MUa)  •••  M{x2]^'{Xff_i.X2) 

•  •  •  • 

•  •  •  • 

•  •  •  ■ 

•^'U^_l,x^)M(Xl)  'F{Xh_i,X2)M{x2)  —  M(x^_i) 

The  well-posedness  of  eqns.  (l)-(2)  together  with  the  uniqueness  of  linear 
least-squares  estimates  guarantee  the  nonsingularity  of  (J+FjFj).  The  com¬ 
ponents  of  the  vector  on  the  right  side  of  eqn.  (33)  are  obtained  from  eqns. 
(28)- (29).  The  solution  of  eqn.  (33)  is  used  in  eqn.  (30)  to  produce  the 
smoothed  estimate. 

5.  The  Error  Covariance 

The  smoothing  error  z[x)  is  defined  by 

z{x)  =  z{x)  -  z{x) 

Eqns.  (l)-(3)  and  (21)-(23)  imply  that  the  smoothing  error  is  also  charac¬ 
terized  by  a  multipoint  boundary  value  problem  as  follows: 


z[x)  =  Az{x)  +  BB'i-zJx])  +  Bu(x).  x  e  ] 

-4(x)  =  -A'(-zJx))  +  C'C2(x)  +  C'u(x).  X  e  \ 

Z  ir  (-Zc(^o))+Z  K  K  (-Zc(^w-i))=  ^ 

j.oL  ®  J  L^oJ  j-iL  j  L  ^N-i  J  L^. 
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A  change  of  coordinates  with 


^ix)  =  N{x)z[x)-z^[x) 

5  . 

*'‘W„-.).  J=W-1 

transforms  the  above  equations  into 

^{x)  =  {A-BB'N{x))z{x)  +  BB'^ix)  +  Bu[x),  xe[Xo.x^_i]  (34) 

^(x)  =  -(A -  BB'N{x)Y^[x)  +  N{x)Bu{x)  +  C'v[x),  x  e  [Xo.Xjv-J \  Uj}j=?  (35) 

•Vo  +  QN(Xo)  -QTz{Xo)l_^!!yrVj  Q<i>'(Xj.Xo)TzUj)l  rrl 

_  -KoNiXo)  KoUm}  ^[o  Kj  J  [oJ 

As  before,  if  we  let 

lo(x)  =  -(A  -  BB'NMY^oix)  +  N(x)Bu{x)  +  C'u(x).  )  =  0  (37) 

Zo{x)  =  {A-BB'N[x))Zo{x)  +  BB'^oM  +  Bu[x),  ZoUo)  =  0  (38) 

then  for  x^.i<x^k,  l<k<N-l, 

z(x)  =  z„(x)+  'f'(x.x„)z(x„)  +  |;  'F(x.Xj)M(Xj)5.  +XM(x)'f"(Xj.x)ai^  (39) 

J»1  J=fc 
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where 


[J+F1F21 

'z(^o)' 

55, 

r' 

0 

+  ^1 

'  ^o(^o)  ' 
^o(‘^l) 

Zq  (x^_i  )_ 

(40) 


From  rWD]  we  know  that 

(41) 

(42) 


EiUxMiXo)]  =  WUoX  E[z„(a:)|'U„)1  s  0 
>,  f 'f'U.s)M(s).  JC2S 


Therefore 


P(x)  =  E[z(x)z'(x)] 

=  M(x)  +  R(x)(7  +  FiF2)-‘ 
■K'S'(x) 


Q  0 
0  0 


iV(Xo)  O' 
0  L 


P'. 


[I  +  F,Fj-^R'[x) 


-R{x][I  +  F,F^r 


0 


-[S(x)Ko  0](H-F,F2)'-^F'(x) 


(43) 


where  for  Xfc.i<x^fc,  l<k<N-l, 

S(x)  =  [‘F(x,Xi)M(Xi)  •••  'F(x,Xfc_JM(Xfc_i)  M[x)'F'[x^.,x)  •••  M(x)'F'(x„_i,x)] 
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and 


i?(x)  =  [‘P(x.Aro)  Six)] 


Appendix 


From  eqn.  (18). 


z^iXo)  =  0'[Xi,Xo]zJXi~)+ p  0'[^,Xo)C'v[^)d^ 

JXg 


But 


zjxi-)  =  5j+zjx,+) 


and  from  eqn,  (18) 


z^iXi+)  =  0'ix2,x^)z^ix2-)  +  P^  0'[^,Xj)C'vi^)d^ 


Therefore 


zjxo)  =  <3>'(Xi,Xo)5,  +  0'{x2,Xo)zJX2-)+r*0'{^,Xo)C'vi^)d^ 

^*0 
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Continuing  in  the  same  fashion,  we  get 


N-2 


ZciXo)  =  '^<I>'{Xj.Xq)5j  +  <P'(x„_i.Xo)ZcU/v-i)+ ^'[^.Xo)C'v{^)d^ 

■'■*0 


J=1 


Substituting  into  eqn.  (19)  gives 


S-2 


Y[Kj  +  Ko0'{Xj.Xo)]5j+[Kf^.^+Ko0'{Xs.i,Xo)]z^[Xn_^)  +  Kor''''  0'{^,Xo)C'v[^)d^  =0 

''*0 


J=1 


With  the  {Kj  given  by  eqn.  (20),  zJXff.i)  and  the  {5j  can  be  obtained  uniquely 
from  the  above  equation,  and  in  fact  are  given  by  eqns.  (14)-(15).  Integra¬ 
ting  eqn.  (18)  with  the  values  given  in  eqns.  (14)-(15)  will  produce  eqn. 

(11).  Therefore  the  boundary  value  problem  of  eqns.  (18)-(19)  is  well-posed 
and  its  solution  is  given  by  eqn.  (11). 
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